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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
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EXAMINER'S STATEMENT OF REASONS FOR ALLOWANCE 

Response to Amendment 

1 . This action is responsive to applicant's amendment and remarks received on 5/15/09. 
Claims 1-23 are currently pending. 

2. Claims 1-23 are allowed. 

3. The following is an examiner's statement of reasons for allowance: 
Regarding claim 1, the most relevant prior art of record, Schmid, Roehrig, with Hull 
combination, teaches feature point extracting means for extracting a feature point from each of 
the object image and the model image; feature quantity retention means for extracting and 
retaining, as a feature quantity, a density gradient direction histogram at least acquired from 
density gradient information in a neighboring region at the feature point in each of the object 
image and the model image, the density gradient direction histogram storing a number of points 
near the feature point having each of a plurality of gradient directions; feature quantity 
comparison means for comparing the feature quantity of each feature point of the object image 
with the feature quantity of each feature point of the model image and generating a candidate- 
associated feature point pair having similar feature quantities; and model attitude estimation 
means for detecting the presence or absence of the model on the object image using the 
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candidate-associated feature point pair and estimating a position and an attitude of the model, if 
any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by wherein the feature quantity comparison means itinerantly shifts one of the 
density gradient direction histograms of feature points to be compared in density gradient 
direction to find distances between the density gradient direction histograms by sequentially 
shifting all of the feature points in the one of the density gradient direction histograms one by 
one to generate a plurality of shifted histograms, and generates the candidate-associated feature 
point pair by determining a shortest distance between (1) an other of the density gradient 
direction histograms and (2) the one of the density gradient direction histograms and the shifted 
histograms. 

Regarding claim 5, the most relevant prior art of record, Schmid, Roehrig, with Hull 
combination, teaches feature point extracting means for extracting a feature point from each of 
the object image and the model image; feature quantity retention means for extracting and 
retaining, as a feature quantity, a density gradient direction histogram at least acquired from 
density gradient information in a neighboring region at the feature point in each of the object 
image and the model image, the density gradient direction histogram storing a number of points 
near the feature point having each of a plurality of gradient directions; feature quantity 
comparison means for comparing the feature quantity of each feature point of the object image 
with the feature quantity of each feature point of the model image and generating a candidate- 
associated feature point pair having similar feature quantities; and model attitude estimation 
means for detecting the presence or absence of the model on the object image using the 
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candidate-associated feature point pair and estimating a position and an attitude of the model, if 
any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by wherein the feature quantity comparison means itinerantly shifts one of the 
density gradient direction histograms of feature points to be compared in density gradient 
direction to find distances between the density gradient direction histograms and generates the 
candidate- associated feature point pair by assuming a shortest distance to be a distance between 
the density gradient direction histograms, and wherein the model attitude estimation means 
repeatedly projects an affine transformation parameter determined from three randomly selected 
candidate-associated feature point pairs onto a parameter space and finds an affine 
transformation parameter to determine a position and an attitude of the model based on an amine 
transformation parameter belonging to a cluster having the largest number of members out of 
clusters formed on a parameter space. 

Regarding claim 9, the most relevant prior art of record, Schmid, Roehrig, with Hull 
combination, teaches feature point extracting means for extracting a feature point from each of 
the object image and the model image; feature quantity retention means for extracting and 
retaining, as a feature quantity, a density gradient direction histogram at least acquired from 
density gradient information in a neighboring region at the feature point in each of the object 
image and the model image, the density gradient direction histogram storing a number of points 
near the feature point having each of a plurality of gradient directions; feature quantity 
comparison means for comparing the feature quantity of each feature point of the object image 
with the feature quantity of each feature point of the model image and generating a candidate- 
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associated feature point pair having similar feature quantities; model attitude estimation means 
for detecting the presence or absence of the model on the object image using the candidate- 
associated feature point pair and estimating a position and an attitude of the model, if any (see 
Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by candidate-associated feature point pair selection means for performing 
generalized Hough transform for a candidate-associated feature point pair generated by the 
feature quantity comparison means, assuming a rotation angle, enlargement and reduction ratios, 
and horizontal and vertical linear displacements to be a parameter space, and selecting a 
candidate-associated feature point pair having voted for the most voted parameter from 
candidate-associated feature point pairs generated by the feature quantity comparison means, 
wherein the model attitude estimation means detects the presence or absence of the model on the 
object image using a candidate-associated feature point pair selected by the candidate associated 
feature point pair selection means and estimates a position and an attitude of the model, if any 
wherein the feature quantity comparison means itinerantly shifts one of the density gradient 
direction histograms of feature points to be compared in density gradient direction to find 
distances between the density gradient direction histograms and generates the candidate- 
associated feature point pair by assuming a shortest distance to be a distance between the density 
gradient direction histograms. 

Regarding claim 10, the most relevant prior art of record, Schmid, Roehrig, with Hull 
combination, teaches feature point extracting means for extracting a feature point from each of 
the object image and the model image; feature quantity retention means for extracting and 
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retaining, as a feature quantity, a density gradient direction histogram at least acquired from 
density gradient information in a neighboring region at the feature point in each of the object 
image and the model image, the density gradient direction histogram storing a number of points 
near the feature point having each of a plurality of gradient directions; feature quantity 
comparison means for comparing the feature quantity of each feature point of the object image 
with the feature quantity of each feature point of the model image and generating a candidate- 
associated feature point pair having similar feature quantities; and model attitude estimation 
means for detecting the presence or absence of the model on the object image using the 
candidate-associated feature point pair and estimating a position and an attitude of the model, if 
any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by wherein the feature quantity comparison means itinerantly shifts one of the 
density gradient direction histograms of feature points to be compared in density gradient 
direction to find distances between the density gradient direction histograms and generates the 
candidate- associated feature point pair by assuming a shortest distance to be a distance between 
the density gradient direction histograms, and wherein the feature point extraction means extracts 
a local maximum point or a local minimum point in second-order differential filter output images 
with respective resolutions as the feature point, i.e., a point free from positional changes due to 
resolution changes within a specified range in a multi-resolution pyramid structure acquired by 
repeatedly applying smoothing filtering and reduction resampling to the object image or the 
model image. 
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Regarding claim 1 1, the most relevant prior art of record, Schmid, Roehrig, Lowe with 
Matsuzaki combination, teaches feature point extracting means for extracting a feature point 
from each of the object image and the model image; feature quantity retention means for 
extracting and retaining a feature quantity in a neighboring region at the feature point in each of 
the object image and the model image, the feature quantity being a density gradient direction 
histogram storing a number of points near the feature point having each of a plurality of gradient 
directions; feature quantity comparison means for comparing the feature quantity of each feature 
point of the object image with the feature quantity of each feature point of the model image and 
generating a candidate-associated feature point pair having similar feature quantities- each 
candidate-associated feature point pair including one feature point of the object image and one 
feature point of the model image; and model attitude estimation means for detecting the presence 
or absence of the model on the object image using the candidate-associated feature point pair and 
estimating a position and an attitude of the model, if any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, Lowe with 
Matsuzaki combination by wherein the model attitude estimation means repeatedly projects an 
affine transformation parameter determined from three randomly selected candidate-associated 
feature point pairs onto a parameter space and finds an affine transformation parameter to 
determine a position and an attitude of the model based on an affine transformation parameter 
belonging to a cluster having the largest number of members out of clusters formed on a 
parameter space. 

Regarding claim 14, the most relevant prior art of record, Schmid, Roehrig, Lowe with 
Matsuzaki combination, teaches feature point extracting means for extracting a feature point 
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from each of the object image and the model image; feature quantity retention means for 
extracting and retaining a feature quantity in a neighboring region at the feature point in each of 
the object image and the model image, the feature quantity being a density gradient direction 
histogram storing a number of points near the feature point having each of a plurality of gradient 
directions; feature quantity comparison means for comparing the feature quantity of each feature 
point of the object image with the feature quantity of each feature point of the model image and 
generating a candidate-associated feature point pair having similar feature quantities; model 
attitude estimation means for detecting the presence or absence of the model on the object image 
using the candidate-associated feature point pair and estimating a position and an attitude of the 
model, if any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, Lowe with 
Matsuzaki combination by candidate-associated feature point pair selection means for 
performing generalized Hough transform for a candidate-associated feature point pair generated 
by the feature quantity comparison means, assuming a rotation angle, enlargement and reduction 
ratios, and horizontal and vertical linear displacements to be a parameter space, and selecting a 
candidate-associated feature point pair having voted for the most voted parameter from 
candidate-associated feature point pairs generated by the feature quantity comparison means, 
wherein the model attitude estimation means repeatedly projects an affine transformation 
parameter determined from three randomly selected candidate-associated feature point pairs onto 
a parameter space and finds an affine transformation parameter to determine a position and an 
attitude of the model based on an affine transformation parameter belonging to a cluster having 
the largest number of members out of clusters formed on a parameter space, and wherein the 
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model attitude estimation means detects the presence or absence of the model on the object 
image using a candidate-associated feature point pair selected by the candidate-associated feature 
point pair selection means and estimates a position and an attitude of the model, if any. 
Regarding claim 15, the most relevant prior art of record, Schmid, Roehrig, Lowe with 
Matsuzaki combination, teaches feature point extracting means for extracting a feature point 
from each of the object image and the model image; feature quantity retention means for 
extracting and retaining a feature quantity in a neighboring region at the feature point in each of 
the object image and the model image, the feature quantity being a density gradient direction 
histogram storing a number of points near the feature point having each of a plurality of gradient 
directions; feature quantity comparison means for comparing the feature quantity of each feature 
point of the object image with the feature quantity of each feature point of the model image and 
generating a candidate-associated feature point pair having similar feature quantities; model 
attitude estimation means for detecting the presence or absence of the model on the object image 
using the candidate-associated feature point pair and estimating a position and an attitude of the 
model, if any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, Lowe with 
Matsuzaki combination by wherein the model attitude estimation means repeatedly projects an 
affine transformation parameter determined from three randomly selected candidate-associated 
feature point pairs onto a parameter space and finds an affine transformation parameter to 
determine a position and an attitude of the model based on an affine transformation parameter 
belonging to a cluster having the largest number of members out of clusters formed on a 
parameter space, and wherein the feature point extraction means extracts a local maximum point 
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or a local minimum point in second-order differential filter output images with respective 
resolutions as the feature point, i.e., a point free from positional changes due to resolution 
changes within a specified range in a multi-resolution pyramid structure acquired by repeatedly 
applying smoothing filtering and reduction resampling to the object image or the model image. 
Regarding claim 16, the most relevant prior art of record, Schmid, Roehrig, with Hull 
combination, teaches at least one processor performing the steps of, extracting a feature point 
from each of the object image and the model image; extracting and retaining, as a feature 
quantity, a density gradient direction histogram at least acquired from density gradient 
information in a neighboring region at the feature point in each of the object image and the 
model image, the density gradient direction histogram storing a number of points near the feature 
point having each of a plurality of gradient directions; comparing the feature quantity of each 
feature point of the object image with the feature quantity of each feature point of the model 
image and generating a candidate- associated feature point pair having similar feature quantities; 
and detecting the presence or absence of the model on the object image using the candidate- 
associated feature point pair and estimating a position and an attitude of the model, if any (see 
Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by wherein the comparing itinerantly shifts one of the density gradient direction 
histograms of feature points to be compared in density gradient direction to find distances 
between the density gradient direction histograms by sequentially shifting all of the feature 
points in the one of the density gradient direction histograms one by one to generate a plurality 
of shifted histograms, and generates the candidate-associated feature point pair by determining a 
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shortest distance between (1) an other of the density gradient direction histograms and (2) the 
one of the density gradient direction histograms and the shifted histograms. 
Regarding claim 17, the most relevant prior art of record, Schmid, Roehrig, with Lowe 
combination, teaches at least one processor performing the steps of, extracting a feature point 
from each of the object image and the model image; extracting and retaining a feature quantity in 
a neighboring region at the feature point in each of the object image and the model image, the 
feature quantity being a density gradient direction histogram storing a number of points near the 
feature point having each of a plurality of gradient directions (see Non-Final Rejection on 
2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Lowe 
combination by comparing the feature quantity of each feature point of the object image with the 
feature quantity of each feature point of the model image and generating a candidate- associated 
feature point pair having similar feature quantities, each candidate-associated feature point pair 
including one feature point of the object image and one feature point of the model image; and 
detecting the presence or absence of the model on the object image using the candidate- 
associated feature point pair and estimating a position and an attitude of the model, if any, 
wherein the detecting repeatedly projects an affme transformation parameter determined from 
three randomly selected candidate-associated feature point pairs onto a parameter space and finds 
an affine transformation parameter to determine a position and an attitude of the model based on 
an affine transformation parameter belonging to a cluster having the largest number of members 
out of clusters formed on a parameter space. 
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Regarding claim 18, the most relevant prior art of record, Watanabe, Schmid, Roehrig, with Hull 
combination, teaches image input means for imaging an outside environment to generate the 
input image; feature point extracting means for extracting a feature point from each of the input 
image and the model image; feature quantity retention means for extracting and retaining, as a 
feature quantity, a density gradient direction histogram at least acquired from density gradient 
information in a neighboring region at the feature point in each of the input image and the model 
image, the density gradient direction histogram storing a number of points near the feature point 
having each of a plurality of gradient directions; feature quantity comparison means for 
comparing the feature quantity of each feature point of the input image with the feature quantity 
of each feature point of the model image and generating a candidate-associated feature point pair 
having similar feature quantities; and model attitude estimation means for detecting the presence 
or absence of the model on the input image using the candidate-associated feature point pair and 
estimating a position and an attitude of the model, if any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Watanabe, Schmid, Roehrig, with 
Hull combination by wherein the feature quantity comparison means itinerantly shifts one of the 
density gradient direction histograms of feature points to be compared in density gradient 
direction to find distances between the density gradient direction histograms by sequentially 
shifting all of the feature points in the one of the density gradient direction histograms one by 
one to generate a plurality of shifted histograms, and generates the candidate-associated feature 
point pair by determining a shortest distance between (1) an other of the density gradient 
direction histograms and (2) the one of the density gradient direction histograms and the shifted 
histograms. 
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Regarding claim 19, the most relevant prior art of record, Watanabe, Schmid, Roehrig, with 
Lowe combination, teaches image input means for imaging an outside environment to generate 
the input image; feature point extracting means for extracting a feature point from each of the 
input image and the model image; feature quantity retention means for extracting and retaining a 
feature quantity in a neighboring region at the feature point in each of the input image and the 
model image, the feature quantity being a density gradient direction histogram storing a number 
of points near the feature point having each of a plurality of gradient directions (see Non-Final 
Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Watanabe, Schmid, Roehrig, with 
Lowe combination by feature quantity comparison means for comparing the feature quantity of 
each feature point of the input image with the feature quantity of each feature point of the model 
image and generating a candidate-associated feature point pair having similar feature quantities 
each candidate-associated feature point pair including one feature point of the object image and 
one feature point of the model image; and a model attitude estimation means for detecting the 
presence or absence of the model on the input image using the candidate-associated feature point 
pair and estimating a position and an attitude of the model, if any, wherein the model attitude 
estimation means repeatedly projects an affine transformation parameter determined from three 
randomly selected candidate-associated feature point pairs onto a parameter space and finds an 
affine transformation parameter to determine a position and an attitude of the model based on an 
affine transformation parameter belonging to a cluster having the largest number of members out 
of clusters formed on a parameter space. 
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Regarding claim 20, the most relevant prior art of record, Schmid, Roehrig with Hull 
combination, teaches a feature point extracting unit configured to extract a feature point from 
each of the object image and the model image; a feature quantity retention unit configured to 
extract and retain, as a feature quantity, a density gradient direction histogram at least acquired 
from density gradient information in a neighboring region at the feature point in each of the 
object image and the model image, the density gradient direction histogram storing a number of 
points near the feature point having each of a plurality of gradient directions; a feature quantity 
comparison unit configured to compare the feature quantity of each feature point of the object 
image with the feature quantity of each feature point of the model image and generating a 
candidate-associated feature point pair having similar feature quantities; and a model attitude 
estimation unit configured to detect the presence or absence of the model on the object image 
using the candidate-associated feature point pair and estimating a position and an attitude of the 
model, if any (see Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, with Hull 
combination by wherein the feature quantity comparison unit itinerantly shifts one of the density 
gradient direction histograms of feature points to be compared in density gradient direction to 
find distances between the density gradient direction histograms by sequentially shifting all of 
the feature points in the one of the density gradient direction histograms one by one to generate a 
plurality of shifted histograms, and generates the candidate-associated feature point pair by 
determining a shortest distance between (1) an other of the density gradient direction histograms 
and (2) the one of the density gradient direction histograms and the shifted histograms. 
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Regarding claim 21, the most relevant prior art of record, Schmid, Roehrig, Lowe with 
Matsuzaki combination, teaches a feature point extracting unit configured to extract a feature 
point from each of the object image and the model image; a feature quantity retention unit 
configured to extract and retain, as a feature quantity, a density gradient direction histogram at 
least acquired from density gradient information in a neighboring region at the feature point in 
each of the object image and the model image, the density gradient direction histogram storing a 
number of points near the feature point having each of a plurality of gradient directions (see 
Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, Lowe with 
Matsuzaki combination by a feature quantity comparison unit configured to compare the feature 
quantity of each feature point of the object image with the feature quantity of each feature point 
of the model image and to generate a candidate-associated feature point pair having similar 
feature quantities, each candidate-associated feature point pair including one feature point of the 
object image and one feature point of the model image, each feature quantity not including 
gradient magnitude information; and a model attitude estimation unit configured to detect the 
presence or absence of the model on the object image using the candidate-associated feature 
point pair and estimating a position and an attitude of the model, if any, wherein the model 
attitude estimation unit is configured to repeatedly project an affine transformation parameter 
determined from three randomly selected candidate- associated feature point pairs onto a 
parameter space and to find an affine transformation parameter to determine a position and an 
attitude of the model based on an affine transformation parameter belonging to a cluster having 
the largest number of members out of clusters formed on a parameter space. 
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Regarding claim 23, the most relevant prior art of record, Schmid, Roehrig, Lowe with 
Matsuzaki combination, teaches a feature point extracting unit configured to extract a feature 
point from each of the object image and the model image; a feature quantity retention unit 
configured to extract and retain, as a feature quantity, a density gradient direction histogram at 
least acquired from density gradient information in a neighboring region at the feature point in 
each of the object image and the model image, the density gradient direction histogram storing a 
number of points near the feature point having each of a plurality of gradient directions (see 
Non-Final Rejection on 2/17/09). 

Applicant's claimed invention distinguishes over the Schmid, Roehrig, Lowe with 
Matsuzaki combination by a feature quantity comparison unit configured to compare the feature 
quantity of each feature point of the object image with the feature quantity of each feature point 
of the model image and to generate a candidate-associated feature point pair having similar 
feature quantities, each feature quantity not including gradient magnitude information; and 
a model attitude estimation unit configured to detect the presence or absence of the model on the 
object image using the candidate-associated feature point pair and estimating a position and an 
attitude of the model, if any, wherein the model attitude estimation unit is configured to 
repeatedly project an affine transformation parameter determined from three randomly selected 
candidate- associated feature point pairs onto a parameter space and to find an affine 
transformation parameter to determine a position and an attitude of the model based on an affine 
transformation parameter belonging to a cluster having the largest number of members out of 
clusters formed on a parameter space, and wherein the feature quantity comparison unit is 
configured to generate the dissimilarity for each respective candidate-associated feature point 
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pair by itinerantly shifting by one step the plurality of gradient directions for one of the object 
image and the model image to compute a number of similarities to a number of the plurality of 
gradient directions, and to take a minimum dissimilarity to be the dissimilarity. 

Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

Conclusion 

4. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to EDWARD PARK whose telephone number is (571)270-1576. 
The examiner can normally be reached on M-F 10:30 - 20:00, (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed can be reached on (571) 272-7413. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 



Application/Control Number: 1 0/5 1 7,6 1 5 Page 1 8 

Art Unit: 2624 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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